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A generalization of fluctuation theorems in stochastic processes is proposed. The new theorem 
is written in terms of posterior probabilities, which are introduced via the Bayes theorem. In 
usual fluctuation theorems, a forward path and its time reversal play an important role, so that a 
microscopically reversible condition is essential. In contrast, the microscopically reversible condition 
is not necessary in the new theorem. It is shown that the new theorem adequately recovers various 
theorems and relations previously known, such as the Gallavotti- Cohen-type fluctuation theorem, 
the Jarzynski equality, and the Hatano-Sasa relation, when adequate assumptions are employed. 



The discovery of fluctuation theorems is one of the 
most important developments in nonequilibrium physics. 
(There are many review articles; for example, see refs. 1 
and 2 and references therein.) The fluctuation theorems 
are applicable not only in near equilibrium but also far 
from equilibrium, and hence it is believed that the fluc- 
tuation theorems play an important role in the study for 
nonequilibrium physics. There are some types of fluctu- 
ation theorems, such as a Gallavotti-Cohen (GC) fluc- 
tuation theorem Jjl 3, [jl, [§[ and an integral fluctua- 
tion theorem [jjl flOL fl ll. Il2j. The GC fluctuation theo- 
rem is related to a symmetry of a certain quantity, and 
applicable if one considers the average of the quantity 
over a large time span. In contrast, the integral fluc- 
tuation theorem can be used for any finite time span. 
It has been known that the integral fluctuation theorem 
directly gives the Jarzynski equality, which connects a 
free energy difference between two equilibrium states and 
a non-equilibrium work required to move a equilibrium 
state to the other one in a finite time 0, [l(| El EH EH • 

Usually, the fluctuation theorems focus on a quantity 
which is defined by a forward path and its time rever- 
sal H , and the average of the quantity over all forward 
paths are taken. The existence of the time reversal means 
that the system has a microscopically reversible condi- 
tion [tj [lClj ]. However, it is an open question whether 
we can obtain a kind of fluctuation theorems when the 
microscopically reversible condition is not satisfied. In 
addition, it has been known that the Jarzynski-like iden- 
tity also holds even in a nonequilibrium steady state; the 
Hatano-Sasa relation connects a Shannon entropy differ- 
ence and an excess heat for Langevin dynamics describing 
nonequilibrium steady states [lq . However, as pointed 
out in ref. 15, the integral fluctuation theorem is not di- 
rectly related to the Hatano-Sasa relation. 

In the present paper, we give a new fluctuation theo- 
rem with the GC-type symmetry for stochastic processes 
in terms of 'posterior probabilities'. The posterior proba- 
bility is a conditional probability for an initial condition 
(or state), that is assigned after an outcome (or final 
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state) is taken into account. The posterior probabilities 
always exist for arbitrary stochastic processes, and hence 
the microscopically reversible condition is not needed. 
The key point in the new formulation is the usage of 
the Bayes theorem, which naturally introduces the pos- 
terior probabilities. The Bayes theorem has widely been 
used in applications of spin glass theory to information 
processing[16j. In addition, there is also a work in which 
the Bayes theorem was used to improve an experimen- 
tal estimation of free energy differences via the Jarzyn- 
ski equality [17| ■ Another usage of the Bayes theorem in 
nonequilibrium physics will be shown in the present pa- 
per; the Bayes theorem is used to avoid the usage of the 
microscopically reversible condition. 

We will show that the new fluctuation theorem recov- 
ers various known results using adequate assumptions. If 
a local detailed balance condition is employed, the mi- 
croscopically reversible condition is satisfied, and hence 
the posterior probabilities are rewritten in terms of usual 
conditional probabilities for time reversals. As a conse- 
quence, the usual GC-type fluctuation theorem is recov- 
ered. When transitions between isothermal equilibrium 
states are considered, we obtain the Jarzynski equality 
from the new fluctuation theorem. In addition, if we 
consider a Langevin dynamics describing nonequilibrium 
steady states, the new fluctuation theorem leads to the 
Hatano-Sasa relation directly. 

We first explain general settings and notations. In the 
present paper, a general stochastic process on a discrete 
set of states, {n}, is considered. Instead of the discrete 
states, it is also possible to use a continuous state space. 
Extensions to continuous cases are straightforward; sum- 
mations in the following discussions should be replaced 
by integrals for the continuous state space. 

Assume that the stochastic system is specified by a 
set of control parameters, a, and that the system has 
a steady state for each a. The steady state probability 
distribution for state n in the control parameter a is de- 
noted as p ss (n;a). Note that the steady state may be 
in equilibrium or in nonequilibrium, which depends on a 
problem to be considered. The system is manipulated by 
changing the value of a during the interval from t = 
to t = T. In addition, the system is assumed to be in a 
steady state initially. 
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According to a usual path integral formulation, we dis- 
cretize the time t S [0, T] as £j G {to, tit . . . ,tjy}, taking 
the limit N — > oo keeping T fixed finally. The value of 
a at time ti is denoted as ai, and a state n at time ti is 
written as rii. In addition, a path, which is a set of states 
(no , n\ , . . . ,un), is denoted as [n] . 

A probability n(ni + i \rii; ai) is defined as the transition 
probability from rii to n^+i under the control parameter 
a t in one time step. Hence, the average of a quantity 
<?([rt]), which depends on a path [n], is evaluated as 



(9) - Yl ( II A n i+i\ n ^ a i) ) 

{n,} V i=0 ) 



p ss (n ;a )9(M)- (1) 



Since the above equation would become exact after tak- 
ing the limit of N — > 00, we use the symbol ~. 

In order to give the new fluctuation theorem, new 
quantities As sys , As m , and As tot are introduced as fol- 
lows: 



A S sys = lnp ss (n ;ao) 

N-l 



lnp(n N ]a N ), 



(2) 



A,s m = J2 (lnp S >m; <*i) ~ lnp ss (n i; a,)) , (3) 



i=0 

As tot = As sys + A& 



(4) 



The quantity As sys is a Shannon entropy difference be- 
tween the initial state and the final one. Note that there 
is no need to set the final state as a steady state; the prob- 
ability distribution at final time is arbitrary, and usually 
it would be determined by the time development of the 
system. 

The main theorem in the present paper is as follows; 



i=0 
/N-l 



J\ ir{n i+1 \m\aLi) p ss (n ; a ) exp (-AAs tot ) 



^ J\ ir p (ni\n i+1 ; ai) p(n N ;a N ) 

{n,} \ »=0 / 

x exp (-(A - l)As tot ) , 



(5) 



where 7r p ai) is a posterior probability. The pos- 
terior probability is a conditional probability for a (previ- 
ous) state rii assuming that the next state is Note 
that the posterior probability is well defined even if we do 
not have the microscopically reversible condition. Sym- 
bolically, eq. ([5]) is rewritten as 

(exp (-AAs tot )) = (exp (-(A - l)As tot )) p , (6) 

where (-) p is the expectation value evaluated using the 
posterior probabilities. 

We here give a proof of the new fluctuation theorem. 
Using the Bayes theorem, the posterior probability is 
evaluated by 

p , 1 v ir(n t+1 \n l ;a l )p ss (n l ;a l ) 

ir v (n l \n l+1 ;a l ) = — ; r . 7 

p ss {n i+1 ;ai) 



Although the Bayes theorem is applicable if the state 
is not a steady one, the posterior probability does not 
change depending on whether the prior probability is 
the steady one or not. Hence, we here considered the 
probability in the steady state. Replacing the condi- 
tional probability 7r(nj_|_i \rii] ai) in the l.h.s. of eq. (J5j) as 
ir p (ni\n i+ i;ai)p ss (n l+ i;ai)/p ss (n t ;ai), the relation (0) is 
immediately obtained. 

Equations (J5]) (or ([6])) is the main result of this pa- 
per. The microscopically reversible condition is not nec- 
essary for the new formulation, and we therefore expect 
that the new fluctuation theorem ([5]) is an extension of 
usual fluctuation theorems. Henceforth, we confirm that 
the new fluctuation theorem ((5]) is consistent with pre- 
viously known results; we discuss connections with some 
of known results, i.e., the usual GC-type fluctuation the- 
orem, the Jarzynski equality, and the Hatano-Sasa rela- 
tion. 

Firstly, we show how the usual GC-type fluctuation 
theorem is recovered from the new fluctuation theorem 
([5|) . In order to discuss the GC-type fluctuation theorem, 
we consider a situation in which the control parameter a 
remains fixed, so that we omit a here. In addition, due to 
the time-independent property of the system, the system 
is also in a steady state at the final time step. Employing 
a local detailed balance condition, a time reversal of [n] 
is naturally introduced. Because we consider a Markov 
process, the forward path [n] has a path probability 

Prob(no — » n\ — > 112 • ■ ■ — > tin) 
= 7r(ni|n )7r(n 2 |ni) • • • 7r(nAr|nAr_i). (8) 

The corresponding path probability for its time reversal 
[n] rov = (ho, hi, . . .h N ) is 

Prob(no ~ * hi — » hi ■ ■ • — > njv) 
= Prob(no <— ti\ <— 712 • ■ ■ <— Hjv) 
= 7r(n |ni)7r(ni|n 2 ) • • '^(rijv-ilnjv), (9) 

where hi = riN—i- Using the transition probability for 
the time reversal, the local detailed balance condition is 
expressed by 

Tr(n i+ i\ni)p ss (rii) = Tr(ni\ni +1 )p ss (n i+1 ), (10) 

where ir(rii\n i+ i) is not the posterior probability, but the 
usual transition probability for the time reversal. Hence, 
we obtain 



p SB (rii) _ n(rii\n i+1 ) 



p ss (n i+ i) Tr(n l+1 \ni) 
and then the quantity As m is written as 

7r(n i+ i\rii) 



As m = In 



n 



ir(m\n. l+ i) 



(11) 



(12) 



Thus, the corresponding quantities of the time reversal 
for As m and As sys are 



n 

. 8=0 



■n(hi +1 \hj) 
Tr(hi\h i+ i) 



= -Ai 



(13) 
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and 



A.' 



sys.rev _ lrl „ss/~ 



\np ss (h ) - \n ss p(n N ) = -As s 



(14) 



In addition, combining the local detailed balance condi- 
tion ([TO]) and the Bayes theorem ((7|), we have 



ir p (ni\n i+1 ) = Tr(ni\n i+1 ). 



(15) 



Using the above identities (eqs. ([Hi]) . fT4]) . (fTST) ). the r.h.s 
of eq. ([5]) is rewritten as 



E 



v-i \ 

J] ^{ ni \m+i) p ss (n N )exp(-(\~ l)As tot ) 

i=0 / 

E ( II ^(^l^+i))p ss (^)exp(-(A-l)A s tot ) 

{n;} V i=0 / 



\ " 



'N-l 



x exp (-(A - l)As sys ' rcv — (A — l)As m ' rov ) 



[[ w(n i+ i\ni) I p ss {n ) 

{„;} V i = / 

x exp (-(1 - A)As sys - (1 - A)As m ) 



(16) 



where the second equality uses the fact that summing 
over the time reversal [n] rov is the same as summing over 
the forward paths [n] since both sums cover all the possi- 
ble paths. Note that, for the third equality, the summa- 
tion for {rij} is equal to that of {rij} rev . If the final time 
T is large enough, one may expect that As sys is negligible 
compared with As m . If so, we obtain 



1 



T lim ( -ln(exp(-AA,s m )) 



= T lim I - In (exp (-(1 - A)A,s m )) 1 , (17) 

which is the GC-type fluctuation theorem given by 
Lebowitz and SpohnQ. 

Secondly, we recover the Jarzynski equality from the 
new fluctuation theorem ([5]). In order to discuss the 
Jarzynski equality, we should specify a stochastic model. 
If not, thermodynamic quantities are not well-defined. 
Here, we mainly obey the Crook's discussions 11]. As- 
sume that a system with a constant temperature heat 
bath. Using the inverse temperature (3 = l/(ksT), where 
/cb is the Boltzmann constant, the probability for state 
rii under a set of control parameters ai is 



p sa (nf,ai) = 



Z{cti) 



(18) 



where Z{pii) is the partition function. At each time step, 
the system may make a stochastic transition from state 
rii to rij+i, which has an energy difference E{ni + i] o^) — 



E(rii\ai). This causes an energy transfer from the heat 
bath in the form of heat. Hence, the total heat exchanged 
with the heat bath in a stochastic path [n] is 



Q[n] 



E 

i=0 



{E(ni +1 ;ai)-E(ni;ai)}. (19) 



Defining the energy difference between the initial state 
and the final one as 

AE = E(n N ;a N )-E(n ;a ), (20) 

and the Helmholtz free energy difference as 

AF--ilnZ(a A r) + llnZ(a ), (21) 



the quantity As tot becomes 

As tot = (3 (AE - Q - AF) . 



(22) 



Using the usual definition of the work performed on the 
system, 



W = AE - Q, 



(23) 



and setting A = 1 in the new fluctuation theorem ^ , we 
have the Jarzynski equality 



(exp (-/3W)) = exp (-0AF) . 



(24) 



Thirdly, we discuss a connection with the Hatano-Sasa 
relation. We consider a Langevin dynamics driven by an 
external force 



7 dT 



dU{x; 9) 
dx 



(25) 



where £(i) represent Gaussian white noise whose inten- 
sity is 2^fk^T. The external force / and a control param- 
eter for potential, 9, specifies the nonequilibrium steady 
state of the Langevin dynamics; we define a set of control 
parameters as a — (f,9). In the nonequilibrium case, it 
is impossible to write the probability in the steady state 
in the form of the Boltzmann distribution. Hence, we 
merely write it as p ss {x; a). As explained before, the new 
fluctuation theorem ([6]) is also applicable to the contin- 
uous state space. Setting A = 1 and the final state as a 
steady state, we have 



IN-1 



(26) 



which is actually the starting point for the derivation of 
the Hatano-Sasa relation; see eq. (9) in ref. 15. Thus, 
the new fluctuation theorem immediately recovers the 
Hatano-Sasa relation. The Hatano-Sasa relation is ex- 
pressed as follows: 



(exp [-/3Q ex - A0]) = 1 



(27) 
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<2ox is the excess heat [HI, [l8| which is defined by sub- 
tracting the housekeeping heat from the total heat, and 
Acj) is the Shannon entropy difference between the initial 
and final states [l^|. Although the usual fluctuation the- 
orem is not directly related to the Hatano-Sasa relation, 
as denoted in ref. 15, the new fluctuation theorem ([5|) 
adequately gives the Hatano-Sasa relation. 

In conclusion, we showed a new fluctuation theorem 
in terms of posterior probabilities. The microscopically 
reversible condition, which is used in usual fluctuation 
theorems, is not necessary for the new fluctuation the- 
orem. We confirmed that the new fluctuation theorem 
adequately recovers previously known results, i.e., the 
GC-type fluctuation theorem, Jarzynski equality, and 
Hatano-Sasa relation when we consider adequate stochas- 
tic models, respectively. We expect that this new fluc- 
tuation theorem would be applicable for some chemical 
reactions without the microscopically reversible condi- 
tion. Whenever each chemical reaction does not have its 
reverse reaction, the usual fluctuation theorems cannot 
be used because it is impossible to define a time reversal. 
The new fluctuation theorem is available even in such 
cases; the applications of the new fluctuation theorem 
are future works. 

Finally, we comment that the usage of Bayes theorem 
and the posterior probabilities may open up new possi- 
bilities for the study of nonequilibrium physics. Actu- 
ally, the posterior probabilities have also been used in 
the study of nonequilibrium steady states[n|[2il[2l|]. As 
explained, the posterior probabilities are naturally intro- 
duced via the Bayes theorem, without the microscopi- 



cally reversible condition. Although it is an open prob- 
lem whether the usage of the posterior probabilities is 
crucial in nonequilibrium physics or not, at least we clar- 
ified that many theorems and relationships are recovered 
from the new fluctuation theorem in a unified way. In ad- 
dition, it may be possible to determine (forward) condi- 
tional probabilities experimentally; performing many tri- 
als and measuring initial and final states, the conditional 
probabilities would be evaluated. Similarly, the posterior 
probabilities may also be measurable. If one considers a 
specific stochastic model, the posterior probabilities may 
be calculated analytically. However, as pointed out in 
ref. 19, the evaluation of the posterior probabilities will 
be difficult practically, even in numerical calculations; it 
could be an interesting problem to evaluate the posterior 
probabilities efficiently. 

We hope that the new formulation gives further 
insights and techniques for studies of nonequilibrium 
physics. 
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